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Overview 



• Background 

• Objectives 

• Approach 

-Uncertainty Classification 
-Defining elementary errors 

• Instrumentation 

• Random 

• Systematic 

-Monte Carlo Simulation 
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Why? And Why Now? 


• As technology progresses, the changes on the 
variables of interest get smaller. Researchers need to 
know that the change of interest (for example, 1 % 
increase in thermodynamic efficiency) are 
measureable and not within the uncertainty of the 
measurement. 

• The uncertainty of the operating condition of the 
facility directly impacts the uncertainty of the 
measured variable. 
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Objectives 



• Develop Measurement Uncertainty Analysis 
Knowledge in the GRC Testing Division 


• Develop a tool to analyze Instrumentation 
Level uncertainties in all facilities 


Determine Facility characteristic uncertainties 
for all aeropropulsion test facilities at GRC 


• Train all GRC Testing Division Staff in the 
uncertainty analysis process 
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Approach 

• Determine the variable(s) of interest 

• Determine the uncertainty sources 

• Determine a usable data set 

• Define a model 

• Analyze 
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Random Vs. Systematic 
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Uncertainty Type Classification 



• ISO GUM: 

- Type A: evaluate by statistical analysis of observations 
(calculated with a standard deviation) 

- Type B: evaluate by other means (based on calibration 
certificates, past experience, etc.) 

- No distinction between “random” and “systematic” to avoid 
ambiguity 

• Distinguishing between Random and 
Systematic is useful in determining changes 
that will improve facility uncertainty. 

- comparison with CFD results cares more about systematic 
uncertainty 

- tests looking at the effect of model changes will care more 
about random uncertainty. 
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Uncertainty Propagation 
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• Note: Once calibration 
simulation is complete, both 
random and systematic 
standard uncertainties are 
“fossilized” and represented 
as systematic standard 
uncertainties for test 
simulation 
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Uncertainty Propagation chart: Mach Number in Supersonic Range 
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Elemental Errors: Instrumentation 

Uncertainties 



• Spreadsheet based 

• ISO Guide to the Expression of Uncertainty in Measurement (GUM)* 



*JCGM 100:2008 Evaluation of Measurement Data - Guide to the Expression of Uncertainty in Measurement 
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Elemental Errors: Random Uncertainties 



• Random deviation about the measured value 

• Mean Value: 


N 



i= 1 


• Standard deviation: 
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Input true 
values of 
variables 
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and 
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uncertainties 
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Randomly 
generate an error 
along error 
distribution for 
each uncertainty 
source 


T,bm,l-8 


i b 


P T.bm 


: S, 


PT.bm 


A 


p 


P T.bm.n 


(/) 


P T.bm.n 


(/) 


bar 


T,arr,l-7 


Run 

simulation 
: / = 1 to M 
iterations 


Pbar 


A 


fiPbarJ') 


PT,arr,unif 

bp. r 
r T,arr 

S P t 
r T,arr 


! * J .k $PT,arr,unif,n ^ 

PpT.arrJ') 

i ^ A €p T,arr,n ^ 



Apply error 
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appropriate 

variables 
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I Systematic Uncertainty 
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Determining Potential Improvements 



• Quantify the effects of: 

- Modifying calibration process 

- Increasing number of data points available for analysis 

- Improving instrumentation 

- Improving flow quality of facility 

- Modifying run time operations 


> Perform cost-benefit analysis for effective facility 
and data improvement 
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Conclusions 



• Thorough investigations of uncertainties in facilities at GRC underway 

• Instrumentation level uncertainties will be easily identified using new 
spreadsheet tool, “MANTUS” 

• Categorizing uncertainties as “random” and “systematic” useful in 
determining potential areas of improvement 

• In-depth uncertainty analysis results and potential improvement 
scenarios provide keys to understanding how facilities and data can 
continue to improve 
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